rub smb the wrong way

irritate others with something one says or does

Her lack of politeness always rubs me the wrong way.